Iterative Text-Based Editing of Talking-Heads Using Neural Retargeting

Talking Heads

This paper describes an interactive presentation that introduces the Talking Heads website, which was originally proposed at the AVSP'97 meeting in Rhodes, Greece. Talking Heads is an effort to bring together information from a wide range of sources. The site provides interactive access to multimodal material in both its original form and as summarized by us. In addition, the authors have provi...

Sample-Based Synthesis of Talking Heads

Image-based Talking Heads using Radial Basis Functions

In recent years talking heads have received a great deal of interest, both in their application to natural humancomputer dialogue, and their benefit to the intelligibility of synthesised speech. A model for the realistic synthesis of visual speech animation is described in this paper. Images representing the key visual speech poses (visemes) are pre-recorded and labelled. Transitions between vi...

A text-speech synchronization technique with applications to talking heads

In human communication, speech understanding is greatly improvedby the bimodal acoustic-visual effect with respect to simple speech communication, in particular when the communication takes place in noisy environments. In this paper we propose a novel synchronization procedure between text and speech, to reduce the time consumption in the development of friendly audio--visual interfaces or auth...

Retargeting cued speech hand gestures for different talking heads and speakers

Cued Speech is a communication system that complements lip-reading with a small set of possible handshapes placed in different positions near the face. Developing a Cued Speech capable system is a time-consuming and difficult challenge. This paper focuses on how an existing bank of reference Cued Speech gestures, exhibiting natural dynamics for hand articulation and movements, could be reused f...